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Abstract 

A general principle is advanced allowing the classification of nonunique solu- 
tions to nonlinear evolution equations, corresponding to different spatio-temporal 
patterns. This is done by defining the probability distribution of patterns, which 
characterizes multiple solutions as more or less probable with respect to each 
other. The most probable pattern is naturally defined by the maximum of the 
pattern distribution. This maximum is shown to be equivalent to the minimum 
of local contraction. The formulated principle plays for nonequilibrium dynam- 
ical systems the same ordering role as the condition of minimal free energy for 
equilibrium statistical systems. The generality of the principle is illustrated by 
several examples of different nature. 
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1 Introduction 



The problem of pattern selection is an old problem that has not yet found an appro- 
priate solution. This problem appears when a system of nonlinear evolution equations 
possesses, under the same initial and boundary conditions, several solutions describing 
different spatio-temporal structures. Suppose, for convenience, that these solutions can 
be parametrized by a multiparameter (3 from a manifold B. It often happens that all 
solutions labelled by different P E B are stable, then manifold B is called the stability 
balloon [1] . Since all solutions from the ensemble attached to the stability balloon are 
stable, there is no general way of distinguishing between such solutions and therefore 
between the related patterns. But the necessity of distinguishing them arises because 
the real life, that is assumed to be described by the corresponding evolution equations, 
does distinguish between different patterns: some of the latter appear in a given exper- 
imental protocol more often than other. Experiments demonstrate that Nature does 
prefer some patterns as more probable. 

A similar problem exists in equilibrium statistical mechanics where it often happens 
that a nonlinear equilibrium system possesses several solutions for an observable quan- 
tity, say for an order parameter. The way of treating such a nonuniqueness of solutions 
for equilibrium systems is well known, being given by the condition of the minimal free 
energy: More stable is that solution and, respectively, that thermodynamic state which 
corresponds to the lower free energy, the lowest free energy defining an absolutely sta- 
ble state. But for nonequilibrium systems, there is no such a general ordering principle 
permitting one to distinguish between more and less probable solutions. This problem 
of pattern selection has been thoroughly described in the detailed review [1] where one 
can find numerous references. 

The aim of the present paper is threefold: (i) To formulate a general principle of 
pattern selection for nonequilibrium systems; (ii) To derive its equivalent representa- 
tions that could be convenient for different cases; (iii) To emphasize the generality of 
the suggested principle by analysing different special applications. 

2 Pattern Distribution 

Consider a system of nonlinear evolution equations, which displays the multiplicity of 
solutions corresponding to different patterns. Let these solutions be parametrized by 
a multiparameter f3 from a manifold B. For the simplicity of notation, let us examine, 
first, the case when the considered problem can be reduced to a d-dimensional system 
of ordinary differential equations written in the normal form 

^^y{t)^v{y,t), (1) 

where the state y{t) = {yi{t) = yi{(3,t)\ i = l,2,...,(i} and velocity field v{y,t) ~ 
{vi{y, t) \ i — 1,2, . . . ,d} are the vectors, in which P & B, and d pertains to a countable 
set. Evolution equations of many rather complicated systems can often be presented in 
the form (1), including many continuous systems after the reduction of their dynamics 
to the center manifold [2]. After examining the form (1), it will be straightforward to 
generalize the consideration for the system of partial differential equations. 
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As far as Nature does prefer some of the dynamical states, labelled by j3, as more 
probable, there should exist a probability measure on the manifold B. If we were able to 
define a probability distribution p{j3, t) for a dynamical system having at the moment 
t a dynamical state y{t) = y{P,t), this would be actually the solution of the problem 
of pattern selection: Then a pattern labelled by Pi would be preferred over another 
one labelled by P2 if p{Pi: t) > p(/?2, t). The most probable pattern would be given by 
the maximum of pattern distribution. 

According to the ideas of statistical mechanics [3], a probability p is related to 
entropy 5 as p ~ . Or, since it is not entropy itself but rather its variation 
that is measurable, it is more appropriate to write p ~ e"^^. Hence the probability 
distribution can be presented as 

= J- e-^sm ^ 2{t) = I e-^^(^'*) d/3 . (2) 



Z{t) ' Jb 

Thus, the most probable pattern corresponds to the minimum of entropy variation. 

In order that the principle of pattern selection would be not just a declaration but 
a working tool, it is necessary to express the entropy variation through the dynamical 
states y{P,t). For a nonequilibrium system., the entropy variation can be naturally 
defined as the difference 

A5(i) = S{t) - S{^) (3) 

with respect to the initial time, which is a kind of relative entropy [4]. Here and in 
the following intermediate expressions, we shall omit, for brevity, the labelling mul- 
tiparameter (3, always keeping in mind its existence and restoring it in final formu- 
las. The entropy may be defined as the logarithm of an elementary phase volume, 
S{t) = In |5 r(t)|; the latter, for a dynamical system., being 5 V{t) — Hi ^Uiit). There- 
fore, the entropy variation (3) writes 

AS{t)^ln\Sm\/Sm\ ■ (4) 

Introducing [5] the multiplier matrix M{t), with the elements Mij{t) = 6yi{t)/6yj{0), 
and initial condition Mjj(O) = Sij, the elementary phase volume can be presented as 
ST(t) = Ui j:jMij(t)5yj(0), from where AS(t) = ln|niEj Mij(t) Mji(0)\. Taking 
into account the initial condition for the multiplier matrix, the entropy variation (4) 
becomes 

AS{t) = Y^ln\Mu{t)\. (5) 

i 

Consequently, the pattern distribution (2) acquires the form 

PW,t) = ^ expj-^ \n\Mu{f3,t)\j ^ W) ^ \Mu{P,t)\-' . (6) 

In this way, for an ensemble of dynamical states y{P, t), one may define the multiplier 
matrix and calculate the pattern distribution (6). 

In addition to expression (6), it is useful to give one more representation for the pat- 
tern distribution. For this purpose, let us introduce the matrix L[t) with the elements 
Lij{t) = In \ Mij[t)\. Then the entropy variation (5) reads 

AS{t) = Tr L{t) = Lu{t) ■ (7) 
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Varying the evolution equation (1), one gets the equation 



I M{t) = J(y, t) M{t) , J,,(y, t) ^ , (8) 

for the multipher matrix, where J is the Jacobian matrix. 

To define the entropy variation (7), one, actually, does not need to know the whole 
multiplier matrix but only the trace of the matrix L{t). As far as the trace of a matrix 
does not depend on its representation, one can accomplish intermediate transformations 
in a chosen particular representation, returning at the end to the form valid for arbitrary 
representations. Here, at intermediate steps, we may consider the representation where 
the multiplier matrix is diagonal. If so, equation (8) yields for the diagonal elements of 
the multiplier matrix Mait) = exp | /q Jii{y{t'),t')dt'^. Then, the diagonal elements of 

the matrix L(t) are Ln{t) = Jq ReJii{y{t'),t')dt' . Let us introduce the quantity K{t) = 
Xlj ReJjj(|/, t). Without the loss of generality, one may assume that the evolution 
equation (1) is written for real functions, since an equation for a complex function can 
always be presented as a pair of equations for real functions. Hence the eigenvalues of 
the Jacobian matrix are either real or, if complex, come in complex conjugate pairs. 
This implies that J2i Re Jii{y,t) = Tr J{y,t). Therefore the notation for K can be 
written as 

K{t)^TrJ{y,t). (9) 

The latter, in dynamical theory [6] , is termed the contraction rate. Using the equality 
Tr L{t) — jQK{t')dt', we find for the entropy variation (7) 

AS(t) = /* K(t') dt' . (10) 
Jo 

With Eq. (10), we get the pattern distribution 

p{P:t) = ^ exp|-|J K{t') dtj . (11) 

Defining the local contraction 

A{t) =- f K{t') dt' , (12) 
t Jo 

one may write AS{t) = A{t)t. Then the pattern distribution (11) takes the form 

p(At)= ^ exp{-A{f3,t)t} . (13) 

The latter shows that the most probable pattern is given by the minimum of local 
contraction. 

The generalization to the case when evolution equations (1) represent a set of partial 
differential equations is straightforward. Then the dynamical state y{t) = {yi{x,t)} 
consists of functions of time as well as of a set x of continuous, say spatial, variables. 
Then y{t) can be treated as a vector with respect to the discrete index i and to the 
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continuous multi-index x. The multiplier and Jacobian matrices are to be considered 
as matrices in i as well as in a; , having the elements 



Mij{x,x',t) 



Syi{x,t) 
5yjix',0) ' 



Jijl^x, X ,y,t) 



Svi{x,y,t) 
5yj{x',t) 



the initial conditions for the multiplier matrix being Mij{x, x', 0) = 6ij 6{x — x'). Thus, 
employing the matrix notation [5], we may literally repeat the same steps as above, 
keeping in mind that, instead of one index i, we have a pair of i and x. Then the 
sums J2i are to be accompanied by the integrals / dx. The product over a continuous 
variable can be naturally defined [7] as Yixfi^) = ^xp J In f{x)dx. As is clear, for the 
contraction rate (9), we have 



The pattern distribution retains the same form (13), with the same local contraction 
(12), where the contraction rate is given by expression (14). 

In this way, we have shown that each dynamical state y{P,t), corresponding to a 
pattern labelled by a multi- index (3, can always be equipped with a weight defining the 
probability distribution of patterns. The latter can be presented in several equivalent 
forms as (2), (6), (11), or (13). Defining the pattern weights makes it possible to 
organize a hierarchy among different dynamical states of an ensemble {y{f3,t)\ f3 E B} 
of admissible solutions. That state is more preferable, which has a higher weight. The 
largest weight describes the most probable pattern. It is also possible to define the 
average pattern as ascribed to the average (3{t) = Jq (3p{P,t)dp. As for any statistical 
ensemble, one may define the pattern dispersion a'^{t) = /3'^p{/3,t)dp — \P{t)]^, the 
standard deviation, variance coefficient, and so on. 

The general principle for pattern selection is, brieffy speaking, the maximum of 
pattern distribution. This can be reformulated in several forms according to a rep- 
resentation employed. For instance, equation (13) shows that this principle can be 
formulated as the minimum, of local contraction. The latter can be expressed either 
through the diagonal elements of the multiplier matrix or through those of the Jaco- 
biam matrix as 



where trace implies summation over discrete indices and integration over continuous 
variables. The conditions of minimum, dA{(3,t)/d(3 = 0, d'^A{P,t)/d(5^ > 0, define 
/3(t) corresponding to a pattern preferable at time t. For nonequilibrium dynamical 
systems, the local contraction plays the same ordering role as free energy for equilibrium 
statistical systems. 



In order to emphasize the generality of the advanced principle, we shall consider several 
particular cases of nonequilibrium systems having rather different properties. 




(14) 




3 Particular Cases 
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A. One-Dimensional Systems. In this simplest case, the local contraction (12) 
is what is called the local Lyapunov exponent [9-13], which can also be written as 
A(t) = 7 In |Af The limit A = limt^oo A(t) is the global Lyapunov exponent. Thus, 
the local contraction is closely connected with the stability properties of dynamical 
systems. And it becomes clear why a smaller local contraction defines a more probable 
pattern. This is because a smaller local contraction corresponds to a more stable 
dynamical system. 

B. Hamiltonian Systems. The dynamical state y — {q,p} consists of a pair of 
sets, q = {qi{x,t)} and p = {pi{x,t)}, satisfying the system of Hamiltonian equations 
dq/dt = SH/6p and dp/dt = —SH/Sq. For the trace of the Jacobian matrix, one has 
TrJ = Tr {6^H/dpdq — 6'^H/5q6p) = 0, where the trace includes the summation over i 
and integration over x, as in Eq. (14). Consequently, A — K — 0, which means that 
there are no multiple patterns but each pattern is to be uniquely defined by initial and 
boundary conditions. 

C. Chaotic Systems. In the spectrum of Lyapunov exponents, there are positive 
exponents. The sum of the latter is called the Kolmogorov-Sinai entropy [8]. The 
difference with the latter in our case is that the limit A = lim^^oo A{t) is the sum of all 
Lyapunov exponents, but not of only positive ones. Hence, the principle of the local- 
contraction minimum makes it possible to classify even chaotic systems onto more or 
less stable. It is worth emphasizing that the local contraction characterizes the local 
stability. This is important since the asymptotic, as t ^ oo, stability is known to be a 
too rough notion for typical dynamical systems describing realistic physical situations, 
as far as the phase spaces of these systems are usually incredibly complicated, being 
composed of a mixture of stability islands and chaotic domains [14,15]. 

D. Dissipative Systems. These, by definition, have negative contraction rates, 
K = TrJ < 0. The evolution equations for dynamical states y = y{P,t) are often 
written in the form dy/dt — —5F/Sy, where TrS'^F/6y'^ > 0, with F — F[y] being a 
functional of y. Such a form of the evolution equation is typical, e.g., for the evolution 
of order parameters [16]. The local contraction (12) becomes 



In the process of evolution, the state y tends to a solution minimizing the functional 
F[y]. If the latter possesses two or several minima, one encounters the so-called bista- 
bility or, respectively, multistability effects. The minima of F[y] are attractors of the 
dynamical system. Each attractor is surrounded by its basin of attraction. For initial 
conditions inside a basin of attraction, the solution always tends to the corresponding 
attractor. The problem of pattern selection arises when initial conditions are on the 
Julia set separating different basins of attraction. Then the solution may tend to dif- 
ferent attractors. The probability of ending at the corresponding attractor, labelled 
by the index (3, is given by the pattern distribution (13). The highest probability is 
defined by the minimum of the local contraction A{(3, t). 

E. Isolated Systems. Such systems are characterized by nonnegativc entropy 
production [17]. The latter, as follows from Eqs. (3) and (10), is directly expressed 
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through the contraction rate K{P,t) = dS{P,t)/dt > 0. The second law of thermody- 
namics for an isolated system tells that the entropy does not decrease, that is A' > 0. 
The system, as time increases, tends to an equilibrium state, so that K{f3,t) K{j3) 
as t — > oo. Then the local contraction (12) also tends to a constant, A(/9,t) K{[3). 
The thermodynamic system at equilibrium acquires a structure providing the maxi- 
mum of entropy and the minimum of entropy production [17]. Labelling this structure 
by /3o, one has K{[3q) = and K'{j3o) = 0, with K"{f3o) > 0, where primes imply the 
derivatives over /Sq. Assume that in the process of evolution, a noncquilibrium system 
allows the existence of several structures classified by the pattern distribution (13). 
With time, one has 

P{P, t) ~ exp {-K{f3) t} , Z{P, t)c^ j exp{-i^ (/3) t] d(5 , 

as i — > oo. When the system tends to equilibrium, where the contraction rate is 
minimal, and K{f3Q) = 0, then, employing the Laplace method, we find Z[/3, t) ~ 
V^27r7(i), 7(i) = [K" {PQ)t]~^^'^ . Expanding K{P) in the vicinity of its minimum, we 
have 

From here, we see that p{P,t) — > S{P — Pq) as i — > oo. This implies that an isolated 
system tending to equilibrium, even if it possessed the possibility of having several 
structures in the process of evolution, finally acquires the sole structure defined by the 
minimum of local contraction or by the maximum of entropy. The latter two conditions, 
for an equilibrium system, coincide. 

F. Filamentary Structures. It would be instructive to mention an example for 
which theoretical results could be directly compared with experimental observations. 
A good case for this purpose is the problem of the turbulent photon filamentation in 
resonant media with high Fresnel numbers (see reviews [18,19] and references therein). 
The problem of pattern formation in nonlinear optics for high Fresnel numbers F > 10 
is principally different from that for low Fresnel numbers F < 10. In the latter case, 
all arising patterns are uniquely described by the empty-cavity Gauss- Laguerre modes. 
While at high Fresnel numbers the filament patterns have nothing to do with these 
modes displaying a nonunique variety of filaments with different radii. First, it has 
been suggested [20-22] that the problem of pattern selection in nonlinear optics at 
high Fresnel numbers can be treated being based on the condition of minimal average 
energy, by analogy with equilibrium systems. However, such a condition of minimal 
energy, in general, has no grounds for nonequilibrium systems. The latter are to be 
treated by the approach suggested in this paper. For this purpose, let us consider a 
system of resonant two-level atoms. The variables describing interlevel transitions and 
the population difference are given by the statistical averages 

u{r, t) = 2< S~{r, t) > , s(r, t) = 2 < S'{r, t) > (16) 

of the quasispin operators [23]. The evolution equations for these quantities can be 
derived by invoking the method of eliminating field variables [19,23], which yields 

du (9 1 w P 

— = -{iuo + -f2)u + fs , = -2-f2\u\^ + {u*f + f*u)s , 
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(9s 1 

^ = - 2(«*/ + r«)-7i(^-C). (17) 

Here ujq is the atomic transition frequency, 71 and 72 are the longitudinal and transverse 
attenuation parameters, C > is a pumping parameter, and 

/(r, t) = -2id • Eo(r, t) + frad{r, t) , ip{r) = 

frad{r, t) = -^ijp J [v9(r - r ) ^(r' , t) - e^9?*(r - r) u*{r', t)] dr' , 

with 7 = (4/3)A;Q(iQ, /cq = t^o/c, p being the density of atoms, and d = d^e^ being 
the transition dipole. The seed field Eq = | Ei e*^''''"'^*) + |E^ ^-t{kz-ujt) selects 
the longitudinal mode with u = kc and with a small detuning from the resonance, 
I A| <C a;o, /S. = uj — ujq. The evolution equations (17) are nonlinear integro-differential 
equations which may possess several solutions. Despite that the pumping is uniform, 
there may appear self-organized transverse modes visible as radiating filaments. The 
solutions describing a filamentary structure can be presented as the sums over Nf 
filaments, 

N; Nf 

u{r, t) = J2 Mr±, t)e''' , s{r, t) = J2 ^^"(r^, t) , (18) 

n=l n=l 

where r_i = y/x'^ + y'^ and the functions m„ and s„ are assumed to be essentially nonzero 
around the axis of an n-th filament but fastly decreasing outside the filament, so that 
UmUn ~ Smn, s^Sn ~ Smn, ^-nd UmSn ~ S^n- Substituting expausious (18) into Eqs. 
(17), we obtain the evolution equations for the filament functions and s„. These 
equations compose an infinite-dimensional dynamical system. To simplify the problem, 
we may pass from the infinite-dimensional system to its center manifold that would be 
of finite dinemsionality. To this end, let us introduce the averaged functions 

u{t) = f Un{r±,t) dr , s{t) = f Snir±,t) dr , (19) 

with the averaging accomplished over the cylinder enveloping the n-th filament. The 
volume of the enveloping cylinder is Ki = nb'^L, where bn is the cylinder radius and L 
is the length of the sample. The enveloping cylinder radius 6„ is related to the filament 
radius r„ by the conservation-energy relation J \un{r±,t)\^dr — T4|it„(r„, i)p. This 
relation cnvolves the function since a filament as such is defined by its radiation 
intensity which is proportional to Assuming that the profile of the function 

\U'n{'i^±,t)\'^ is well approximated by the normal law exp(— r]^/2r^), we obtain 

bn = (4e)^/^ rn = 1.82 r„ . (20) 

The whole sample is supposed to have the cylindrical shape of radius R and length L, 
with the relation R <^ L typical of lasers. The radiation wavelength is X <^ R. The 
evolution equations for the averages (19) take the form 

^ = -{in + r)u + As , ^ = -2r\u\' + {u*h + , 
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r7s 1 

- = -g^M' - ^{u*fi + flu) - 7i(5 - C) , (21) 

where Vl = ujq + '~f2g's is the collective frequency, F = 72(1 — gs) is the collective width, 
/i = —id • Eie~*'^*, and the effective coupling parameters arc 

^ ^ 37P /• sin(fcor - kz) g'^^ f cosjkor - kz) 

472 Jvn kor ' 472 Jvn kor 

Equations (21) can be solved by invoking the scale separation approach [24]. Taking 
into account the standard inequalities 7 ^ ujq, 71 ^ ujq, and 72 ^ ujq, the solutions 
to Eqs. (21) can be classified onto fast, u, and slow, |Mp and s. Treating the slow 
functions as quasi-invariants, for the fast solutions one has 

„(,) = L - e-""--)' + e-' . 

y LU — il + irj uj — il + zl 

Substituting this into the equations for the slow functions, we average the right-hand 
sides of these equations over time and introduce the function 

,2 2 _ _RC 1 Id-Elf 



w = \ur-as% a= — lim - / u* (t) Mt) dt = —^-—^^—r . (23) 

The role of the seed field is to select a longitudinal mode, the amphtude Ei being small, 
so that a <^ 1. Finally, for the slow functions, we obtain the equations 

duj ^ ,^ . ds ^ , 

— = -272(1 - gs)w , - = -272W - 7i(s - C) , (24) 

defining the guiding-center solutions. From here, we have the contraction rate, given by 
Eq. (9), as K — —71 — 272(1 — gs). The latter depends on the filament radius through 
relations (20) and (22). Therefore, the pattern distribution (11) gives the distribution 
of photon filaments with respect to their radii. The most probable filament radius 
corresponds to the maximum of the pattern distribution (11), that is, to the minimum 
of the local contraction (12). Filaments with different radii have different values of 
coupling parameters (22). The stability analysis of Eqs. (24) shows that all filaments, 
independently of their radii, are stable from the point of view of the asymptotic Lya- 
punov stability. The classification of filaments onto more or less probable happens at 
the initial stage of their formation, when the local contraction (12) is 

A{t) ~ -71 - 272(1 - gso) , (25) 

where Sq = s(0) < 0. The minimum of A corresponds to the maximum of g. Minimizing 
Eq. (25) with respect to the filament radius, we find the most probable radius Vf ~ 
0.3\/ XL, which is in good agreement with experiments (reviewed in Ref. [19]) for 
various laser media. 

G. Time Series. The general principle described in Sec. 2 can also be employed for 
analyzing time series by providing a probabilistic distribution of extrapolated scenarios. 
This is possible since a time series is a realization of a random process corresponding 
to a stochastic dynamical system. Different reahzations of a random process can be 



9 



presented by different time series (wfiicfi we may enumerate by tfie index {3 = 1,2,...) 
representing tlie same random process. Tliis implies tliat tlicrc are several sets of data 
fkiP) associated with the moments of time tk{f3), with k = 0,1,2, .. .. Each set forms 



the data base Dfe(/3) = {fk{P),fk-i{P),---Jo\ tk{P) < < . . . < 0}, where 



the backward time ordering is accepted and the present time moments is set to be 

io(/9) = 0. To extrapolate a time series means to construct a forecast, valid for t > 0, 
on the base containing the data for t < 0. Assuming that the considered random 

process follows the self-similar dynamics [25], we obtain the self-similar forecast 



extrapolating the time series to t > 0. Here Ck = Ck{l3,t) are control functions, or 
controllers, defined by minimizing a cost functional. Each forecast f^{P,t) presents a 
possible scenario for the extrapolated behaviour of the considered time series. In the 
present case, scenario is a synonym for pattern. Hence, we may construct a scenario 
probability pk{0-t) = 1/Zk{t) \Mk{(3,t)\ by using definition (6). Treating the family 
k = 1,2,...} as the trajectory of a dynamical system with discrete time 
A; = 1, 2, . . ., we find the multipliers Mk{(5,t) = 5fl{(5,t)/5fl{(5,t). Introducing the 
average multiplier Mk{t) by the relation Zk{t) = 1/Mk{t) — J^p l/|-^fe(/3, ^)|, we obtain 
the scenario distribution 



most probable scenario is defined by the minimum of the local contraction Ak((3,t) or, 
respectively, by the minimum of the multiplier modulus \Mk{(3,t)\. Several examples 
of particular time series are considered in Ref. [25], where a variant of the scenario 
distribution was postulated. 

In conclusion, a general principle for pattern selection is advanced, based on the 
definition of the probability distribution of patterns. It is demonstrated that the most 
probable pattern corresponds to the minimum of local contraction. The suggested 
approach is shown to be applicable to different dynamical systems describing various 
nonequilibrium phenomena. 



fkiP, t) = /o exp {cit exp {c2t . . . exp (ckt)) . . .) , 



with the local contraction 
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